1 MULTI-RESOLUTION BOUNDARY ENCODING APPLIED 

2 TO REGION BASED STILL IMAGE AND VIDEO ENCODING 

3 Technical Field 

4 The present invention relates to still image and video encoding, and, in particular, to region 

5 based still image and video encoding. 

6 Background 

7 Video encoding may include image encoding and boundary encoding. Existing boundary 

8 encoding techniques, such as MPEG-4, typically use dififerential chain codes for generating region 

9 based encoding. An examples of differential chain encoding is described in MuUer, et. al., 

1 0 "Progressive Transmission of Line Drawings Using the Wavelet Transform," IEEE Transactions On 

1 1 hnage Processing, Vol. 5, No. 4, April 1 996. Differential chain encoding techniques typically use 

Q 

yg 12 directional vectors on a square grid of for example, 4x4 pixels. 

m 

%j 1 3 However, MPEG-4 and other differential chain encoding techniques only code the pixel 

1^ 1 4 boundaries of the regions, and thus may not have an overall multi-resolution representation. As a 

1 5 result, if some information is lost in transmission, the boundary of the whole region may be 

s 16 misplaced. 

0 

gl 1 7 Fourier series based encoding is the next step in boundary encoding, with coordinates of 

Ms 

i y 18 a curve periodically extended and Fourier transformed. However, Fourier series encoding only 

P 1 9 generates good localization in frequency, but not good localization in space. Accordingly, once 

20 there is error in transmission, i.e. , some of the coefficients or data bits are lost, the boundary may 

21 be misplaced. 

22 Summary 

23 A method for applying multi-resolution boundary encoding to region based still image and 

24 video encoding includes dividing an original image into a plurality of regions and detecting a plurality 

25 of boundaries associated with the plurality of the regions. The method further includes encoding 

26 each of the plurality of the boundaries so that each of the plurality of the boundaries contains 
2 7 different resolution coefficients. The method also includes decomposing each of the plurality of the 
2 8 regions in the original image into one or more subbands using the plurality of the boundaries with 
29 the highest resolution coefficients, and successively decomposing each of the plurality of the regions 
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1 in a subband with lower resolution coefficients into one or more subbands using the plurality of the 

2 boundaries with lower resolution coefficients. 

3 The method for applying multi-resolution boundary encoding to region based still image and 

4 video encoding further includes transmitting the lowest resolution boundary and image information, 

5 and successively transmitting higher resolution boundary and image information. 

6 This method uses multi -resolution encoding for image and for boundary and allows for 

7 better error correction for low frequency transmission. By using joint source channel coding 

8 (JSCC) techniques, a receiver with low resolution capability or low channel bandwidth may still 

9 render a close approximation of a boundary despite error in transmission. 
1 0 Description of the Drawings 

Q 1 1 The preferred embodiments of the multi-resolution encoding will be described in detail with 

12 reference to the following figures, in which like numerals refer to like elements, and wherein: 

1 3 Figure 1 illustrates exemplary hardware components of a computer that may be used to 
^14 implement the multi -resolution boundary encoding; 

ffl 15 Figure 2 illustrates £in exemplary boundary encoded at full resolution; 

5 

P 1 6 Figures 3 (a) and 3 (b) illustrate an exemplary method for encoding two one-dimensional 

[\ 17 periodical signals using wavelet based encoding at different resolution levels; 

^ 1 8 Figures 4(a)-(c) illustrates how the exemplary boundary shovm in Figure 2 is represented 

□ 

M 1 9 in multi-resolution encoding; 

20 Figure 5(a) illustrates an exemplary multi-resolution representation for boundaries; 

2 1 Figure 5(b) illustrates an exemplary comparison of Fourier series encoding and wavelet 

22 based encoding with or without transmission errors; 

2 3 Figures 6(a)-(c) illustrate an exemplary image encoding using subband encoding technique; 

24 Figures 7(a)-(d) illustrate an exemplary multi-resolution decomposition of an image and an 

25 associated boundary; 

26 Figures 8(a)-(e) illustrate an exemplary process of progressive reconstruction of the image 

27 and the associated boundary; and 

28 Figure 9 is a flow chart of the exemplary decomposition and reconstruction process 

29 illustrated in Figures 7 and 8 using multi -resolution boundary encoding. 
30 
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1 Detailed Description 

2 A method and an associated apparatus applies multi-resolution boundary encoding to 

3 region based still image and video encoding, allowing better error correction for low frequency 

4 bands. High frequency bands may be less protected, leaving only lower frequency representation 

5 highly protected. A receiver with low resolution capability or low channel bandwidth, such as a 

6 wireless device, may still render a close approximation of a boundary despite error in transmission. 

7 Figure 1 illustrates exemplary hardware components of a computer 1 00 that may be used 

8 to implement the multi-resolution boundary encoding. The computer 1 00 includes a connection 

9 with a network 1 1 8 such as the Internet or other type of computer or telephone networks. The 

1 0 computer 1 00 typically includes a memory 1 02, a secondary storage device 1 1 2, a processor 1 1 4, 

11 an input device 1 16, a display device 110, and an output device 108. 

U 

y3 1 2 The memory 1 02 may include random access memory (RAM) or similar types of memory. 

CP 

si^ 13 The memory 102 may be connected to the network 1 18 by a web browser 106. The web 

1 4 browser 1 06 makes a connection via the world wide web (WWW) to other computers known as 

5^ 1 5 web servers, and receives information from the web servers that are displayed on the computer 

m 

B 16 100. The secondary storage device 1 12 may include a hard disk drive, floppy disk drive, CD- 

Si 17 ROM drive, or other types of non- volatile data storage, and may correspond with various 

I . J 18 databases or other resources. The processor 114 may execute irrformation stored in the memory 

P 1 9 1 02, the secondary storage 1 1 2, or received from the Internet or other network 118. The input 

20 device 1 1 6 may include any device for entering data into the computer 1 00, such as a keyboard, 

2 1 key pad, cursor-control device, touch-screen (possibly with a stylus), microphone, or video camera 

22 (not shown). The display device 1 1 0 may include any type of device for presenting visual image, 

23 such as, for example, a computer monitor, flat-screen display, or display panel. The output device 

24 1 08 may include any type of device for presenting data in hard copy format, such as a printer (not 

25 shown), and other types of output devices include speakers or any device for providing data in 

26 audio form. The computer 1 00 can possibly include multiple input devices, output devices, and 

27 display devices. 

2 8 Although the computer 1 00 is depicted with various components, one skilled in the art will 
29 appreciate that the computer can contain additional or different components. In addition, although 

3 0 aspects of an implementation are described as being stored in memory, one skilled in the art will 
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1 appreciate that these aspects can also be stored on or read from other types of computer program 

2 products or computer-readable media, such as secondary storage devices, including hard disks, 

3 floppy disks, or CD-ROM; a carrier wave from the Internet or other network; or other forms of 

4 RAM or ROM. The computer-readable media may include instructions for controlling the 

5 computer 1 00 to perform a particular method. 

6 Any signal can be represented with scaling fimctions and wavelet fiinctions. The scaling 

7 fimctions, wavelet fiinctions, and other image encoding related mathematical formulas and 

8 algorithms are described, for example, in Chuang, et. al, "Wavelet Descriptor of Planar Curves: 

9 Theory and Applications," IEEE Transactions on Image Processing, Vol. 5, No. 1 , January 1 996, 
1 0 which is incorporated herein by reference. Chuang, et. al. describe a hierarchical planar curve 

■Q 1 1 descriptor that, by using a wavelet transform, decomposes a curve into components of different 

^12 scales so that the coarsest scale components carry the global approximation information while the 

1 3 finer scale components contain the local detailed information. The wavelet descriptor is shown to 

M 1 4 have many desirable properties such as multi-resolution representation, invariance, uniqueness, 

^ 15 stability, and spatial localization. 

f«j 1 6 Multi-resolution pyramid encoding for image is described, for example, in United Patent 

^17 No. 5,477,272, entitled "Variable-Block Size Multi-Resolution Motion Estimation Scheme for 

y 18 Pyramid Coding," which is incorporated herein by reference. U.S. Patent No. 5,477,272 

M 1 9 describes a variable-size block multi-resolution motion estimation scheme that can be used to 

20 estimate motion vectors in subband encoding, wavelet encoding and other pyramid encoding 

21 systems for video compression. 

22 In multi-resolution encoding, image information is sent in increments . Every time more 
2 3 information is transmitted, the image may be better described and rendered. For example, a single 
24 sine wave may be a first approximation of a square wave, which represents an original waveform. 
2 5 Adding more information, for example, a double frequency sine wave with different amplitude, on 

26 top of the original sine wave may generate a second approximation of the square wave. A third 

27 approximation may be generated by adding a higher frequency sine wave with smaller amplitude, 

28 and so on. Every time a new sine wave is added, a better approximation of the square wave, the 

29 original image, may be generated. 
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1 Multi-resolution encoding techniques may be applied to boundary encoding. In multi- 

2 resolution boundary encoding, a periodic wave transfer may be generated with different contents 

3 of frequencies. Figure 2 illustrates an exemplary boundary B- Vq 330 encoded at full resolution. 

4 The boundary is composed of two coordinates, i.e., x{f) and y(t), that evolve in 'V". The 

5 combination of the two coordinates generates the whole boundary. 

6 The boundary may be encoded using two one-dimensional periodic wavelet series. 

7 Wavelet series are described, for example, in "Progressive Transmission of Line Drawings Using 

8 the Wavelet Transform" by MuUer, et. al., IEEE Transactions on Image Processing, Vol. 5, No. 

9 4, April 1 996, which is incorporated herein by reference. Muller, et. al. present a method to apply 

10 progressive transmission to line drawings using wavelet transform. 

1 1 Figures 3(a) and 3(b) illustrate an exemplary method for encoding, i.e., decomposing, two 

O 

k§ 1 2 one-dimensional periodical signals using wavelet based encoding at different resolution levels. 

Ei 

Cj 1 3 Examples of one-dimensional periodical signal encoding are described, for example, in "Wavelets 

^ 14 andSubbandCoding"byVetterliandKovacevic,ISBN0-13-097080-8, 1995,221-223, which 

5^ 15 is incorporated herein by reference, 

s 16 Referring to Figure 3 (a), a one-dimensional curve X(w) is decomposed by subdividing the 

o 

0^ 17 spectrum represented by frequency "w" and generating frequency coefficients forx(f). For 

18 example, waveletcoefficientsinB-Vo330expandallfrequencybandsfromOt07r. Subdividing 

'^'^1 19 the spectrum generates coefficients in B- V 1 43 0, which contains lower frequencies from 0-7c/2, and 

20 B-Wi 440, which contains higher frequencies from ;r/2 to n. Further dividing the spectrum 

2 1 produces coefficients in B-V2 530, which carries lower frequency contents from 0-7t/4, and B-W2 

22 540, which carries higher frequency contents from 7z/4 to 7c/2. Yet further dividing the spectrum 

23 produces coefficients in B-V3 630, which contains lower frequency contents from 0-7c/8, and B- 

24 W3 640, which carries higher frequency contents from 71/8 to 7r/4. 

25 Figures 4(a)-(c) illustrates how the exemplary boundary shown in Figure 2 is represented 

26 in multi -resolution encoding. First, a few data bits with lowest frequency coefficients, which 

27 represent the most basic boundary information, are sent to a receiver during transmission. Then, 
2 8 more data bits with higher frequency coefficients may be sent to render a better approximation of 

29 the boundary. The more data bits with higher frequency coefficients are transmitted, the closer 

30 representation the boundary is to the original image. 
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1 As shown in Figure 4(a), X(w) and Y(w), which form the transformed boundary, may be 

2 reconstructed by first receiving B-V2 530, which contains the lowest frequency contents. Then, 

3 B-W2 540, which carries mid-range frequency contents, may be received, thereby creating a better 

4 boundary. B-V, 430, shown in Figure 4(b), may be generated by combining B-V2 530 and B-W2 

5 540. Lastly, B- Wi 440, which contains the highest frequency contents, may be received, and B- Vq 

6 330, the original boundary shown in Figure 4(c), may be generated by combining B-Vi 430 and 

7 B-Wi 440. As a result, B-Vq 330 is the combination of B-V2 530, B-W2 540 and B-W^ 440, 

8 Figure 5(a) illustrates an exemplary multi-resolution representation for boundaries. An 

9 image, such as a snov^ake, may be transmitted by sending frequency coefficients in increments . 
1 0 The original image with the highest frequency coefficients is shown in (0). The image with the 

P 1 1 lowest frequency coefficients, i.e., the basic shape, is shown in (8). If a receiver has higher 

K 1 2 transmission capability, higher frequency coefficients may be added to generate the image shown 

1 3 in (7), and so on. As illustrated in multi-resolution wavelet based boundary encoding, each time 

™ 1 4 more information is received, the image boundary may be enhanced slightly with higher resolution, 

^15 i.e. , more detail. As for the final layers of transmission shown, for example, in (3), (2), ( 1 ), the 

P 1 6 enhancements generated may not be perceivable by human visual system, and the coefficients that 

-01 

17 generate (3), (2), (1) do not need to be protected against channel errors. Accordingly, high 

Id 

pi 1 8 frequency bands may be discarded, leaving only lower frequency representation. Multi-resolution 

lI 

' 19 boundary encoding enables the basic shape of boundaries to be preserved by transmitting only a 

20 few coefficients. 

2 1 Multi-resolution wavelet based boundary encoding offers a better approach than chain 

22 codes or Fourier series encoding, where if one data bit in the chain code is missing, the whole 

2 3 boundary is misplaced. Figure 5(b) illustrates an exemplary comparison of Fourier series encoding 

24 and wavelet based encoding. Fourier series based encoding uses sine and cosine infinite 

25 waveforms, thus there is no spatial representation. If the frequency of the infinite waveform is 

26 changed slightly, the overall appearance of the image and boundary may be changed. The wavelet 

27 transform, however, has good localization both in space and in frequency. 

28 The original waveform is shown in (a). Changing one coefficient slightly in the Fourier 

29 series encoding generates (b), while changing the similar coefficients slightly in wavelet based 

3 0 encoding generates (c) and (d) . As illustrated, in Fourier series encoding, an error in transmission. 
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1 represented by a slight change in one coefficient, disturbs the entire boundary. On the other hand, 

2 in wavelet based encoding, a similar error results in localized movement of the boundary. 

3 Therefore, if errors exist in the transmission, a receiver is still able to recover the basic coefficients 

4 and render a close approximation of the boundary. 

5 The advantage of localization of modification may be shown best in wireless image 

6 transmission, where noisy channels are used and errors frequently occur. An error in transmission 

7 may affect one or more of the coefficients, typically the high frequency coefficients because the high 

8 frequency coefficients are not as protected as the low frequency coefficients. In Fourier series 

9 encoding, such errors may cause the entire image boundary to be misplaced. However, wavelet 
1 0 based encoding enables the boundary to remain the same, except for the isolated region subj ect 

_ 1 1 to the error, as illustrated in Figure 2(b). Accordingly, wavelet based encoding, more localized and 

Q 

)Q\2 more resilient to errors in transmission, is a preferred encoding method for describing boundaries. 

m 

i^i 1 3 Figures 6(a)-(c) illustrate an exemplary image encoding using a subband coding (SBC) 

P 1 4 technique. Region based subband coding (RBSBC) is described, for example, in "A Region-Based 

^ 1 5 Subband Coding Scheme" by Casas, et. al., Signal Processing: hnage Communication 1 0 (1 997) 

CD 

^ 16 173-200, which is incorporated herein by reference. Casas, et. al. disclose a region-based 

If j 1 7 subband encoding scheme intended for efficient representation of the visual information contained 

1,1 IS in image regions of arbitrary shape . QMF filters are separately applied inside each region for the 

M 1 9 analysis and synthesis stages, using a signal-adaptive symmetric extension technique at region 

20 borders. The frequency coefficients corresponding to each region are identified over the various 

2 1 subbands of the decomposition, so that the encoding steps, namely, bit-allocation, quantization and 

22 entropy encoding, can be performed independently for each region. 

23 An original image I-Vq 310 is shown in Figure 6(a). I-Vq 310 may be filtered and 

24 downsampled to generate subbands I-Vill410, I-Wjhl 421, I-W^lh 423, and I-Wjhh 425, as 

25 illustrated in Figure 6(b). The frequency representations are illustrated in Table 1 . The subbands 

26 I-Vill410, I-Wihl421, I-Wilh423, and I-Wihh 425, drawn on a smaller (1/4 size) grid, may 

27 be combined to reconstruct I-Vq 3 1 0, the original image. 
28 

29 
30 
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1 Table 1 



2 




Horizontal Frequencies 


Vertical Frequencies 


3 


LL 


Low Pass 


Low Pass 


4 


LH 


Low Pass 


High Pass 


5 


HL 


High Pass 


Low Pass 


6 


HH 


High Pass 


High Pass 



7 



8 Referring to Figure 6(c), the subband I- V i ll 4 1 0 may be further filtered and do wnsampled 

9 to generate subbands I-V2LL 510, 1-W2HL 521, 1-W2LH 523, and I-W2HH 525. The subbands I- 
1 0 V2LL 5 1 0, 1- W2HL 52 1 , 1-W2LH 523, and I-W2HH 525, drawn on a yet smaller (1/16 size) grid, may 

|r:^ 1 1 be combined to reconstruct I-Vi ll 410, 

1 2 Figures 7(a)-(d) illustrate an exemplary multi-resolution decomposition of an image and an 

HI 1 3 associated boundary. Figure 7(a) illustrates an original image I-Vq 3 1 0 composed of a set of 

€f 

1 4 regions, i.e., 7 1 0, R2 720, R3 730, and R4 740. The Regions are defined by a set of boundaries 

gi 

fia 1 5 in B-Vo 330, i.e., 8 1 0, B2 820, B3 830, and B4 840. Referring to Figure 7(b), the original image 

L 1 6 I-Vq 310 may be filtered and downsampled to generate subbands I-Vill 410, I-Wihl 42 1 , I-Wilh 

OI 17 423,I-W,HH425foreachoftheregionswithintheimage. I-Vill 410 may be generated using low 

y. 

y 1 8 pass horizontal and low pass vertical (LL) frequency filters, I- hl 42 1 may be generated using 

P 

1 9 high pass horizontal and low pass vertical (HL) frequency filters, I- Wi lh 423 may be generated 

20 using low pass horizontal and low pass vertical (LH) frequency filters, and I- Wj hh 425 may be 

21 generated using high pass horizontal and high pass vertical (HH) frequency filters. All four 

22 subbands have the same boundary resolution, i.e., B-Vj 430. 

23 Figure 7(c) illustrates a further decomposition, where the LL frequency subband I-Vill 4 1 0 

24 is further filtered and downsampled for each of the regions, generating smaller subbands I- V2LL 

25 510,I-W2hl521,I-W2lh523,I-W2hh525. ThesubbandsI-W,HL421,I-WiLH423,I-WiHH425 

26 remain the same. The subbands I-V2LL 510, 1- W2HL 521, 1- W2LH 523 , 1~ W2HH 525 have the same 

27 boundary resolution, i.e., B-V2 530, which has a lower resolution than B-V, 430. 

28 Figure 7(d) illustrates another level of decomposition, where the LL frequency subband I- 

29 V2LL 5 1 0 is further filtered and downsampled for each of the regions, generating yet smaller 
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1 subbands I-V^ll 6 1 0, 1- W3HL 62 1 , 1- W3LH 623 , 1- W3HH 625 . The subbands I- Wjhl 521, 1- W2LH 

2 523 , 1- W2HH 525 remain the same as before. The subbands I- V3LL 6 1 0, 1- W3HL 62 1 , 1- W3LH 623 , 

3 I-W3HH 625 have the same boundary resolution, i.e., B-V3 630, which has ayet lower resolution 

4 than B-V2 530. 

5 Decomposition may be performed as many times as necessary to encode the image and 

6 the corresponding boundary. Because downsampling is typically performed in both directions, one- 

7 fourth of the original data remains after each filtering. After filtering, a pyramid is generated with 

8 different frequency contents, i.e., resolutions. However, only four or five decompositions are 

9 typically performed. As a result of the multiple levels of decomposition, a complete image 

10 compression may be generated based on wavelet coefficients for the boundary and subband 

1 1 coefficients for the image. 

1 2 In transmission, image and boundary information may be sent using j oint source channel 
5 1 3 coding (JSCC) to protect the information against channel errors. JSCC describes techniques in 
^14 which the compression function and the error control function in a communication system are 

ET? 1 5 combined in some way. For example, encoding of the boundary and image may be modified so 

CO 

B 16 that different resolutions may be protected unequally against errors in transmission channels, i.e., 

Q 

1 7 the most important coefficients with respect to the human visual system (HVS) may be well 

18 protected, where the least important coefficients are less protected. 

0 1 9 For example, when video signals are transmitted, image and corresponding boundary 

20 coefficients with the lowest resolution may be sent first. Next, image and boundary coefficients with 

2 1 a higher resolution may be transmitted, and so on. There are more data bits, i.e., energy, to be sent 

22 to encode a boundary in a subband with higher frequency, hnage compression in source encoding 

23 is, in part, obtained by removing or coarsely encoding some of the coefficients in the higher 

24 frequency bands, i.e., quatitization process, as the HVS typically may not notice the difference. 

25 Channel encoding assigns error protection to the image and boundary information, and JSCC 

26 organizes the source coded coefficients in the order of importance with respect to the HVS. JSCC 

27 then applies channel encoding techniques to the source coded coefficients, providing more 

28 protection to the more important, i.e., low frequency, coefficients and less protection to the less 

29 important, i.e., high frequency, coefficients. 
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1 Figures 8(a)-(e) illustrate an exemplary process of progressive reconstruction of a 

2 decomposed image and an associated boundary. First, referring to Figure 8(a), boundary 

3 information with the lowest resolution, i.e., B-V3 630, may be transmitted. Then, image information 

4 in the lowest subband I- V3LL may be sent to fill the boundary. The lowest resolution boundary and 

5 image information, which are well protected against noises and transmission errors, are good 

6 representations of the original image at lower frequency, A receiver with low bandwidth may still 

7 recover this basic approximation. 

8 Referring to Figure 8(b), image information in the other three subbands I- W3HL 62 1 , 1- 

9 W3LH623,andI-W3HH625maybesent. The four subbands I-V3LL6IO, I-W3hl621, I-W3LH 

1 0 623, and I-W3HH 625 share the same boundary resolution, i.e., B-V3 630. This level of image 

1 1 information is less protected against errors. A handheld wireless device, which operates in noisy 

Q 

^ 1 2 channels and has smaller displays, typically only receives this level of approximation. However, the 

13 handheld wireless device may still render a video on the small display, which is a close 

^fl 14 representation of the original boundary and image. 

51 1 5 In Figure 8(c), the four subbands I- V3LL 6 1 0, 1- W3HL 62 1 , l-W^w 623 , and I- W3HH 625 

m 

2 1 6 may be combined to reconstruct the image information in I-V2LL 510. Next, higher resolution 

^ 1 7 boundary information in B- W3 640 (not shown in Figure 8) may be sent. B-V3 63 0 and B- W3 640 

1 8 may be combined to reconstruct B-V2 530, which has a higher resolution. Then, image information 

P 1 9 in the other three subbands I- W2HL 52 1 , 1- W2LH 523, and I- Wshh 525 may be transmitted. Again, 

20 the subbands I-V2LL 5 1 0, 1-W2HL 52 1 , 1-W2LH 523, and I- W2HH 525 share the same boundary 

2 1 resolution, i.e., B-V2 530. The higher resolution boundary and image information are even less 

22 protected against transmission errors. 

23 Similarly, in Figure 8(d), the subbands I-V2LL 510, 1- W2HL 52 1 , 1- W2LH 523, and I-W2HH 

24 525 may be combined to reconstruct the image information in I-Vill 4 1 0. Next, higher resolution 

25 boundary information in B-W2 540 (not shown in Figure 8) may be sent. B-V2 530 and B-W2 540 

26 may be combined to reconstruct B-Vj 430, which has yet a higher resolution. Then, image 

27 information in the other three subbands I-Wjhl 421, I-Wilh 423, and I-Wihh 425 may be 

28 transmitted. Once again, the subbands I-Vjll 410, I-Wihl 421, I-Wjlh 423, and I-Wjhh 425 

29 share the same boundary resolution, i.e., B-Vj 430. The boundary and image at this level of 
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1 resolution are more vulnerable to errors in transmission, because they are not well protected in the 

2 channel coding steps. 

3 Lastly, referring to Figure 8(e), the subbands I-Vj ll 4 1 0, 1- Wj hl 42 1 , 1- Wj lh 423 , and 

4 I-WiHH 425 may be combined to reconstruct the original image I-Vqll 310. The original image I- 

5 Vqll 310 may be reproduced at a receiver. In this embodiment, the highest frequency coefficients 

6 in B- Wi 440 do not need to be transmitted. If a receiver, for example, a high definition television 

7 or a desktop computer, is able to receive the levels of coefficients described above without error, 

8 the receiver may receive a high resolution high quality video scene, or even recover the original 

9 image, as shown in Figure 8(e). 

1 0 Accordingly, multi-resolution encoding both in boundary and in image allows a system 

1 1 designer to protect different sets of coefficients according to transmission channel' s condition. 

□ 

y3 1 2 Different receivers, using different channels, may receive different amount of bits per second, i.e., 

m 

1 3 bandwidth. Hand held low resolution devices may utilize only lower frequency resolution, which 

e" , 14 is well protected. Other receivers, such as high definition televisions, use better channels with 

1 5 higher frequency band and can receive better image quality. 

m 

e 1 6 The image encoding and the boundary encoding use the same subbands for convenience 

O 

Bi 1 7 purposes only. The two types of encoding may be performed separately and do not need to use 

I . j 1 8 the same subbands. In addition, instead of using RBSBC for the image encoding, other encoding 

■^19 methods may be used. 

20 Figure 9 is a flow chart of the exemplary decomposition and reconstruction process 

2 1 illustrated in Figures 7 and 8 using multi-resolution boundary encoding. An original image I- Vq 310 

22 may be divided into a plurality of regions, such as Rj 7 1 0, 720, R3 730, and R4 740, step 910. 

23 A plurality of boundaries, such as Bi 8 1 0, B2 820, B3 830, and B4 840, may be detected, step 

24 910. Next, each of the boundaries may be encoded by two periodic wavelet series, one foTx(f) 

25 and one for y(t% so that each boundary may contain different sets of wavelet coefficients, step 912. 

26 For example, for a three level decomposition, B-Vq 330 may be composed of 2N wavelet 

27 coefficients, N forx(r) andN forXO? B-V, 430 may be composed ofN wavelet coefficients, N/2 

28 for x{t) and N/2 for y(t), B-V2 530 may be composed of N/2 wavelet coefficients, N/4 for jc(/) 

29 and N/4 for y(t), and B-V3 630 may be composed of N/4 wavelet coefficients, N/8 for x(0 and 

30 N/8 forXO. 
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Next, using the boundaries with the highest resolution, i.e., B-Vq 330, each of the regions 
in the original image I-Vq 310 may be decomposed into, for example, four subbands, using a 
RBSBC scheme, step 914. The four subbands may be LL subband I-V,ll410, HL subband I- 
W2HL 521, LH subband I-W2LH, and HH subband I-W2HH, steps 916, 918, 920, and 922, 
respectfully. In the next step, using lower resolution boimdaries, each of the regions in the LL 
subband may be successively decomposed into further four LL, LH, HL, and HH subbands, step 
924. For example, using the boundary B-V, 430, each of the regions in the LL subband, i.e., I- 
Vill410, may be further decomposed into I-V2LL 510, 1-W2HL 521, 1-W2LH 523, 1-W2HH 525. 
hi addition, usmg the boundary B- V2 530, each of the regions in the lower resolution LL subband, 
i.e., I-V2LL 5 1 0, may be further decomposed into I-V3LL 6 1 0, 1- W3HL 62 1 , 1-W3LH 623 , 1- W3HH 
625 . Accordingly, after the successive decomposition, the following subbands are generated: one 
subbands with the lowest image resolution I- Vjll 610, three subbands I- W3HL 62 1 , 1- W3LH 623 , 
I-W3HH 625, three subbands with higher image resolution I- W2HL 52 1 , 1-W2LH 523, 1-W2HH 525, 
and three subbands with even higher image resolution. 

During transmission, these boundary and image information may be sent using JSCC to 
protect the information against channel errors. First, the lowest resolution boundary B-V3 630 may 
be sent, step 926. This boundary information has the highest error protection. Next, the image 
information in the lowest resolution subband I-V3LL 610 may be sent, step 928. This image 
information, again, has the highest error protection, hi step 930, the image information in the lowest 
resolution subbands I- W3HL 62 1 , 1- W3LH 623 , 1- W3HH 625 may be transmitted. The subbands I- 
V3LL 6 1 0, 1- W3HL 62 1 , 1- W3LH 623 , and I- W3HH 625 may be combined to reconstruct I-V2LL 5 1 0 
in a receiver, step 932. 

In the next step, boundary information in a higher resolution may be successively 
transmitted, step 934, together with the image information in a higher resolution HL, LH, and HH 
subbands, step 936. Similarly, the subbands LL, HL, LH, and HH may be combined to 
reconstruct image information in a higher resolution, until the original image I-Vq 310 is 
reconstructed, step 938. For example, boundary information in B-W3 640 may be sent, which, 
by combining B-V3 630, may generate the boundary at resolution B-V2 530, which has high 
protection. Then, the image information in I-W2HL 521, 1-W2LH 523, 1-W2HH 525 maybe sent, 
which may be combined with I- V2LL 5 1 0 to reconstruct I- V 1 ll 4 1 0 . Next, boundary information 
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in B-W2 540 may be sent, which may combine with B-Vj 530, to generate the boundary at 
resolution B-Vj 430, which has medium protection. Finally, the image information in I-W,hl 42 1 , 
I- Wi LH 423 , 1- W 1 HH 42 5 may be sent, which may be combined with I- V 1 ll 4 1 0 to reconstruct the 
original image I-Vq 3 10 in the receiver. 

While the method for multi-resolution boundary encoding has been described in connection 
with an exemplary embodiment, it will be understood that many modifications in light of these 
teachings will be readily apparent to those skilled in the art, and this application is intended to cover 
any variations thereof 
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